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ABSTRACT 

Higher education today is the target of growing 
pressure for improved management procedures. As one response to these 
societal pressures, higher education has developed numerous 
nontraditional patterns of instruction. The purpose of this paper is 
to discusss educational and instructional development, that is, 
change within higher education, and the evaluation thereof, that is 
educational and instructional cost analysis and quality measures as 
they currently exist and operate in higher education, and to 
emphasize particularly how they apply to individual courses of 
instruction. This discussion attempts to identify flaws, problems, or 
difficulties in this area and to illustrate some identified barriers 
in the cost analysis of nontraditional instructional programs. The 
problem areas which have been identified result from present 
techniques that are limited by basic assumptions, procedures, and 
terminology regarding the organization of instructional processes. 
They are, consequently, traditionally oriented and narrow in scope. 
(Author/PG) 
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ins tru:ti onal deve lofment: the prob lems or 

* COSTS AND EFFECTIVENESS 



Higher education today is the target of" prowinp pressure 
for improved rnandgement nrocedures. Institutions of hipher 
education are faced with fiscal constraints, and thev are bein^ 
forcod to make more effective use of the resources at their dis- 
posal. Increasingly J restrictions and conditions are hein^ 
attached to these resources. Coll^L^j-ies and universities are being 
asked to bo accountable, and accountability is bein^ interpreted 
in a broad context. Not onlv must stev/ardshin obli^^ations be met, 
but the provider of funds is demanding assurance that desirable 
benefits result from resources invested, Simultaneouslv , demands 
for accountability are being exercised bv a new breed of student 
desirinp a greater varietv of learn inp orations. 

As one response to these societal rressures, higher educa 
t i on has developed numerous non- tradi t iona 1 patterns of 
instruction. Programs and processes of instructional and 
educational development Ivave been central to manv oi these allerna 
tives. Some of the changes and reforms have been derived ^rom 
purely p^lilosoI>hical bases Vs'hile others have been prompted bv 
financial considerations. SoiplP r^ossess characteristic;^ both. 
Hov;ever, regardless of the motivation or rationale, the financial 
and the nuality implications of educational cbian^^e are bein?^ 
i n crea s i n g 1 v exa m i ne d . 



Tho purpose ot 'iiis oarer is to discuss educational and 
ins true t ioi^a I developrient, that is, chan^^e v;ithin higher education, 
and tho evaluation thereof, that is educational and instructional 
cost-analysis and quality neasures as they currently exist and 
operate in higher education, and to enohasize oarticularlv how they 
ar^ply to individual courses of instruction. This discussion v;ill 
attempt to identify flaws, proble:ns or difficulties in this area and 
to M lust rate some identified barriers in the cost-analysis of non- 
traditional instructional orograns. The problem areas vrhich have 
been identified result from present techniaues which are limited by 
basic assuTTipt ions , procedures, and terminoloe^v regarding the 
organisation of ir.s truct i ona 1 processes. They are, consequent Iv , 
traditionally oriented and narrov; iri scope. 

Av/areness of this is of particular significance in 
instruction for two reasons; first-, most educational changes focus 
directly on the teach ing- learn ing process and the me t hod o logics 
involved; and, secondly, the instructional budgets a+: most inst'.tn- 
tions of higher education constitute 50 percent or more of the 
total budget. The scope of such expenditures is emDhasized in the 
fact that for the fiscal year 19 72-73 higher' education anpropri- 
ations for the fifty states totaled over S8 billion in annual 
op e rating e xpe n s e s . 

It is not the r^urpose of this paper' to resob'e tlie problems 
in their entirety, but rather to bring them to your dttention and 
to suggest how variations in cust-analvs i s r^rocedures , through the 
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colioction of apt>roprlato data, can re:.sult in more irjeanii.gfui 
analysis, and hopefully, decision-makinp,. 

Operating in an environment of tighter cost constraints, 
the acadoniic managor in higher education today is forced to make 
difficult decisions about the allocation o^ the institution's 
resources for instruction. Some programs mav be eliminated, some 
may be curtailed, and few new programs are being initiated. In 
some cases the growth of academic programs must be balanced with 
changing student enrollments, and in other cases, programs may have 
to be combined or reorganized. These decisions must, or should be, 
made with a knowledge of where the funds will come from or where the 
savings will go. 

Fiscal information about the internal operations of 
academic progt-^ams is more important to the effective management of 
higher education institutions today than it was, even five years 
ago. 

Ti-^ends in the cost-analysis of instruction in highet^ 
education suggests two majoi^ hypothesis for this naper. First, 
that higher education in general, and the instructional process in 
particular, is changing. Secondly, that existing cost-analysis 
procedures are intimately tied to the budgetary organizational 
structures employed by colleges and universities. The uhderlv-^ng 
theory indicates that the tvjo hypothesis arc not naturally compatible 

Therefore, if the current instructional cost-analysis 
^^^^^^^^ t to provide a cost picture of the 
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traditional course of iiis traction , they are of even less value in 
providing a cost-analysis of non- traditional patterns of 
instruction. 

The analysis oi- costs associated v?ith higher education has 
been a desirable goal for the past one hundred years ^ and has been 
a practice of institutions to a greater or lesser extent, for at 
least the past forty years. 

One of the najor factors associated with the analysis of 
costs is that it has been undertaken lart^elv by those closest to 
the Information, that is, financial managers and budget officers of 
the institutions involved. This is not to say that the data 
generated is incorrect, or faulty in what it offers. V/e have all 
found it inforrrat ive , interest injr , lielpful and often even supportive. 
One observation [ have made, however, is that administrators, 
faculty, students, board iriembers, foundation of fleers , and even 
legislators, who all employ statistics generated in one wav or' 
anothGi", become confused, lost, or even uninterested once the 
information proceeds beyond basic, somewhat familiar data, such as 
cost per student, average faculty support, student-faculty ratios, 
etc. 

It strikes me that there exist tv;o manor difficulties here, 
both of which are inherent in nature of the analysis conducted, 
Onevdifficulty is the lack, on the part of academic administrators , 
of a good comprehensive understanding of the financial and budgetary 
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stt^uctures emploved by higher education, nat^ticularlv as concerns 
the details and innerworkings of the svstem. 

A second factor^ which I would like to remedy immediately ^ 
is the uncertaintity and possible confusion which eminates from the 
terminology associated with cost-analysis . 

Today, we are surrounded by terms such as cost-benefit- 
analysis , cost -efficiency -analysis , and cost-ef feet iveness-analy sis. 
A brief explanation of each may prove helpful. 

A cost-benefit-analysis is a means for assembling the 
resources, that is, the costs, which are oroposed for use within a 
specific activity, and comparing them with the anticipated or 
expected results, that is, the benefits, which are likely to be 
obtained from that activity. 

This type of analysis is undertaken on a very broad, 
general basis, and may be referred to as '^societal cost-analyj is . 
The concern, naturally focuses ot resources, or costs, but asks such 
questions as '^Is it better, or more beneficial to society, for us to 
engage in energy research or cancer research" ox^ "Should we establish 
an institute for goverrment analvsis or improve the student-faculty 
ratio?*' or "Should the university initiate a new undc -^graduate maior 
in anthropology or should we expand graduate biology to a doctoral 
program? 

Cost-efficiency, the second term which is often used today, 
is the measurement of resources* or costs, involved in the particular 

methodology or set of methodologies available in goal or objective 



accomplishinent . In othei^ v?ords» with a direct concern for the costs 
or resources Involved, the centxvil question is "Are there alternative 
.^e thodoj ogievS avai lable to us in the performance of a particular 
task, and if so, what dees each cost?" 

Consideinng the sets of cost-benefit inquiries posed, we 
can suggest that cost-ef ficiencv questions would bo sub-catefjories 
therein. For example, if we look at the establishment of an 
anthropology fnajor versus a biolop.v doctorate we rnirht look at 
alternative strategies for each and study their costs. Oi^ we might 
analyze the costs of various tvpes of research methodologies avail- 
able for either energy or cancer^ research. 

It may also be determined that an assist by outside funds 
would, of course, be of importance, and reduce the institutional 
commitment. 

The third type of analysis mentioned, that of cost- 
effectiveness, is suggested as being the measurement of resources, 
that is, the cos ts a 1 located to a specific project, activity, or 
objective. Comparatives are possible when, in concert with an 
analysis of the results v;hich are generallv affixed to quality 
standards, di_fforent m.ethodologies are available ^or analysis in 
terms of the alternative courses of action possible* ■ 

Briefly stated, cost-effectiveness analysis involves the 
coiTiparison of the resources required, that is, the cost for, and 
output of , feasible alternative strategies employable in the 
achievement of program objectives. In essence cost-ef f ectiveness : . 



asks» "What is tho cost involved in doinc? what v;e avo doing, and hov? 
effoctivo is the job we ai^e performing?'^ 

Suppose tho question v;ere raised regarding iiriprovement of 
the student-faculty ratio. Can it be imoroved? Are ther^e techniaues 
available outside of increasing the nurpiber of faculty members? What 
if we change the niethodolof^v of instruction? What are the costs 
in\'olved in any of the posoibilities? Wliat would any change have on 
existing programs or on a new anthrooologv curriculum? Hov; are the 
facultv being used now? Hov; will they be used tomorrov;? 

Effici'-ncy and effectiveness relate to each other over the 
long run. Efficiency is the relationship of innut to output. 
Effectiveness, or quality, is the relationship of standards o^ 
accomplishment to output. 

The questions posed are all interrelated-- just as the types 
of cost-analysis are interrelated. One builds upon the other. One 
cannot have an accurate picture of cost-benefit analysis until he 
knov/s the alternative courses of action available within each of the 
major program areas being considered. Tnis involves a thc^rough studv 
of all possible methodologies , available for goal accomolishment , 
with clf^rar statements re swarding the costs and effectiveness 
associated with each. 

Higher education has a double dilemma in this ref:ard--wG 
have problems with both the costs and effectiveness. We have 
trouble analyzing traditional methodologies V but more so in 
analyzing proposed new or alternative patterns-^particularly when it 
concerns instruction, especially individual courses. ., 



The course is the basic unit of instruction in higher 
education. The coiu^se is the unit to which academic credits are' 
attached. An academic progi^am leading to a degree is made up of a 
student's successful completion of a set of courses, which taken 
together, add up to the number and type of academic credits required 
to receive the degree. 

The cost and the quality of an individual course are 
important pieces of information needed to analyse the financial 
im.plications of academic programs. However, current techniques of 
effectiveness m^easurement and instruct ional cost-analysis in higher 
education do not pi^ovide adequate data for either one. 

Let's consider the nature of the comolication , as presented 
to us by the instructional process. 

A non-traditional course is simply a course that does not 
conform v/ith the traditional canons of college instruction. 

The development of the tvpical conventional or traditional 
college course is a relatively standardized process. Designing a 
non- traditional course is not. Unfortunately a single good set of 
rules for designing a non-traditional course does not exist. Once 
one leaves the shelter of traditional assumptions, the options for 
organizing a course of instruction are limitless and there is no 
precise and universally acceptable formula. There are, however, a 
few concepts which help to reduce the complexities of the 
instructional design process j and identify the component parts of 
the instructional process so that architectural-like planning and 



design rPiay result. If one considers instructional design fron the 
comprehensive and systematic point of view v;hich characterizes 
architectural design, then it beconies necessary at the outset to 
define and categorize the components froFi which and of v/hich the 
archi'tectm-'e of instruction will be created. 

All of these instructional components fall into one of 
three genez-'al categories. First, are the different tvpes of 
situations in which instruction takes place. Second, is the varietv 
of v;ays of arranging an exchange of information among teachers and 
learners, and third, would be the resources necessary to facilitate 
the process of instruction. 

Non-traditional instruction, therefore, is concerned with 
instructional design and the ability to rrianipulate and manage the 
countless varieties of non-traditional instruct ional configurations* 

A course of instruction is a vehicle for helping students 
achieve some definite sot o^^ educational objectives. 

The design of a course of instruction v;hich follows the 
statement of objectives involves two major elements. 

First, designing the course svllabus--which is the [)lan for 
the instructional content of the course, and, secondlv , designing the 
course format--that is, the plan for the instructional activities of 
the course. . 

A course design, then, is a plan for the content and the 
activities that will be used to help students achieve the educational 
objectives of a particular course. 
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in des i gtiin^^, a course of instruction, the instructional 
"developer, the faculty, the acadeTTiic department, and the 
institution, must consider two basic questions. The first question 
is, ^'How niuch will it cost to operate a course with this particular 
desi^tn? 

The second question is ^ '^How effective will this 
particular design be in lielping students achieve the course 
objec lives?*' 

If the individuals involved in instructional develonment 
could quantify the answers to these two questions, thov could com- 
pare the cost-effectiveness of al tet^nat ive des igns for a course. 
This would provide data for management decis Lon-making and allow for 
selection of the particular desip,n which would make the most 
efficient use of the institution's resources, and be maximally 
effective In helping each student achieve all o^ the obnectives of 
the course . 

The concept of cost-effectiveness represents a relationshin 
between two individual sets of Tv.easures~-costs and effect iyeness . 
Prior to combining them, consider each separatelv for a moment. 

Cost is a measure of the economic value of the human, 
material and facilitv resources used to develop and operate a course, 
and effectiveness is a measure of how well a particular combiRation 
of resources perform in helping students achieve the educational 
objectives of a course. 
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Although cost-effectiveness is, oi'' at least, could be, a 
useful concept in comparing alternative means for achieving a given 
end, it is difficult, maybe even presently impossible , to use this 
tool with any precision in comparing alternative designs for a 
particular course* 

The difficulty, which is , of course , obvious , is first in 
finding an adequate way to assess the effectiveness of a proposed 
syllabus or format for a course, and second, in the translation of 
an assessment, if conducted, into some ouantifiable unit of measure . 

The measurement of student achievement, for instance, is 
not necessarily a measure of how effective the instructional content 
and activities of a course have been in helping students realize 
these achievements: 

Another difficulty, one that may be somewhat less obvious, 
is that the instructional development team has to test a unit of 
instruction with students before he can make a reasonable assess- 
ment of its effectiveness. And, if he is to test a set of 
alternative designs for a particular unit, this can lead to a very 
long prototype testing program. 

Therefore, in trving to compare the probable effectiveness 
of alternative designs for a course, the instructional developer 
must rely a good deal on experience v hunch, and intuition, 

. , . Although a prototype testing nrogram can imorovo the 
confidence one would have in the effectiveness of a particular 
convs^ design, there is no sure way of forecasting the effectiveness 
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of a syllabus, that is the content, or the format, which are the 
activities during the design stage of course development. 

Costs, on the other hand, are a more manageable measure, 
Although one can calculate costs in various units, dollars are the 
units normally used in assessing the costs of instruct ion , 

We can hang dollar signs on the resources we plan to use 
in a course with a particular desi^^.n, and, as a consequence, we can 
jTonerate a wide variety of cost data from the design alone, without 
ever putting the course into operation. 

Therefore, we can forecast the instructional costs of a 
rarticular coui'^se desip.n--and we can compare the costs of alterna- 
tive designs, v;i th reasonable accuracy , wi thout test inp these 
designs in an operational setting. 

The Newman Report has stated that, it is within 

individual departments and educational rrogiv-^ms that cost-effective- 
ness thinking will be most rewardinp,. . . .because that is where the 
payoff is--in making it less costly for students to learn English, 
or political science, or electric engineering,/' 

And, just last year the Commission on Non-Traditional 
Study found insufficient data to substantiate claims, pro or con, 
regarding the financial implications of non- traditional programs. 

Newman's Task Force on Education contends that this 
situation has developed for two maior reascns.v One is that the ccni- 
plexities involved in cost-analysis allow for it to ])e done had Lv. 
Secondlv, educators fear the results^ primarily because it may burst 
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the huhbio inscvibocl with the ti^oory that cost and oualitv j^ro hand- 
In -hand. 

Hov; did we get Into such a situation? 

In tho face of a financial oir accountabi litv crisis, a 
college or univerc;itv's options are fev; in number. First, it may 
attempt to find nev; resources in order to continue its on^pinp, 
p!X^grams« Second » it may cut back its proprarns to the leyel of 
available resources. Or, third, it inav tt^v to find new ways to make 
more productive use of its i^xisting resoux^ces. 

Traditionally 5 hip,her education inati tution:s , depondinp; • 
upon the times, have acted upon one or the other of the fii^st two 
alternatives. Parely, if at all, have they attempted the third. The 
first two alternatives have been and v;ill continue to be pursued, 
but neither has sufficient range ol effect to provide a Jonp,-term 
solution to the problem because each i^?presents a fixed relation- 
ship between input:" and outputs. Both increased resources and 
reti^enchment affect only the total expenditures of an institution, 
and not the unit cost, of its educational ser^vicos, Increase(^ 
resources provide for i ricreased services ; decreased resources prompt 
rotronchiuent ot crop;ran:s. The results are either more ser-vices ''or 
more cost or fewer services f'*;r less cost. In bo tli Instances the 
ratio of inputs to outputs remains constant. 

Most cos t-analvsis techniques have lieen used to determine 
costs at the system, university, college, school, division or 
departm^^nt levels, v;hile no cos t-ana 1 vs i s techninne >ms been : . 



specif iv:allv designed Lo inoasui^e the financial implications of a 
sinf,lo coarso of instruction. In situations where the costs of 
instruction for individual courses have been determined, it has been 
acconipliGhed through averaging or deriving percentages based on 
overall departmental costs . These derivative costs are often 
inadequate indicators of" the costs to an institution in operating a 
particular course for a semester or acadeuiic year. 

V/hatever past justifications there may be ior not analyzing 
the costs of courses in higher education, the new clinate of 
accountability has changed the need for instructional cost data. 
Colleges and universities today are being pres;sed to produce cost- 
analysis data, not only to validate their bud.i^et requests to funding 
authorities, but also to provide academic nan igement with financial 
data as input' for internal decision-making. 

A question one night ask is *'Whv are the current cost- 
analysis techniques in higher education so ineffective in providing a 
true cost picture of non~ tradi t ional patterns of inst^ruction?" There 
are a couple of i^oasons v/hich deserve our consideration. 

In the first place, current techniques use a financial 
terminology that is tied to traditional patterns of instruction. The 
description of a non-traditional instructional pattern in thes(5 terms 
often falsely describes the educational process which is conducted 
within this pattern* And secondly, in traditional patterns of 
instruction, com^ses may vary in subject field, curricula, level of 
instruction J size of classes, etc., but the cost-structure of all . 



tradi tional cour^^es , with ijoino minor variatfons, ax^o essentially the 
sam:^. Current instructional oost-analvsis techniques are based on 
the assumption that the opera tincr costs associated with a course of 
iriStruction are almost entirely determined by the costs of faculty 
tine used in a course. Other costs primarily those of an instructional 
support nature, are such a snail percentage of the total costs that 
they can be adequately repi^esented by allocatin^r them to the courses 
as a percent of the average support costs of the department offering 
the course. These assumptions are about cost-structures and the types, 
amount and source of resources used in a course are not necessarily 
valid for non- traditional patterns of instruction. 

Consequently, the language and the basic assumptions used 
in current instructional cost-analysis techniques may seriously dis- 
tort the institutional costs of operating academic programs that 
include non- tradi tiona 1 patterns of instruction. 

^his situation presents the academic managed with a double 
dilemma. He cannot adequately determine the cost of individual 
courses of instruction v;ithin an academic program. And i^ the program 
employs non-traditional patterns of instruction, either within the 
conventiondl one semester course struc^'ire, or within some new course 
structure, the current techniques of cost-analvsis are o^ little 
assistance in pi^oviding the data on instructional costs. 

In essence J the educational pt^ocess is changing. Ft is 
already significantly different than it v;as in 1935 whc>n the first 
national comprehensive system for instructional cost-analysis was • 
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developed. The budgetary sti^uclures of hlghet^ education have not 
accommodated these changes. 

In conclusion It can be remembered that the 1971 Newman 
Report, .suggested that, ^^The measurement of cost and performance in 
higher education is somehow regarded as illegitimate/' To this it 
could be added that instructional development > with its complex pro-- 
cedures and crooesses, serves to compound this situation. A ^:5ituation 
it did not create, but nevertheless finds itself entrapped. 



